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[57] ABSTRACT 

A secondary packetized data stream, such as a commercial, 
is spliced with a primary packetized data stream, such as a 
network television program. The system does not require 
decompression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend to 
allow the insertion of commercials from local businesses 
into a nationally broadcast television program. When a start 
signal is received, a pre-splicing packet of the primary 
stream is determined. The pre-splicing packet is the packet 
closest to the start time which carries an anchor frame (e.g., 
I or P frame) start code. To prevent a potential discontinuity 
at the decoder, the pre-splicing packet is processed to discard 
the anchor frame data, and to insert a number of stuffing 
bytes which is equal to the number of bytes discarded into 
an adaptation field of the pre-splicing packet. To further 
maintain continuity at the decoder, identifying data of the 
primary stream such as PID and PSI data, is retrieved and 
provided to the secondary stream. A number of null packets 
are inserted into the output stream at the transition point 
between the main program and the commercial to prevent a 
buffer overflow at a decoder which receives the output 
stream. 

29 Claims, 14 Drawing Sheets 
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SPLICING COMPRESSED PACKETIZED errors, buffer overflow or underflow, timing recovery prob- 

DIGITAL VIDEO STREAMS lems due to discontinuous system time stamps, audio/video 

synchronization problems, and video display artifacts. 

BACKGROUND OF THE INVENTION Furthermore, the system should be compatible with MPEG 

„ . t . . iL • r 5 and similar digjtal data communication standards, in addi- 

The present invention relates to the communication of . , . r\. ... . ... . , , . , 

. ■ • < • j . , , • i i « 4 . tion to being fully compatible with existing decoder tech- 

digital video signals, and more particularly, to the insertion . . ■ *• -a . u~ 

t , -j . *i • * nology. The present invention provides a system having the 

of digital video messages such as commercials into a pre- . j fu a 

• j < , ■ i . i . r above and other advantages. 

existing compressed packetized data stream. Data packets of ° 

the commercial message are spliced into a pre-existing data SUMMARY OF THE INVENTION 
stream (complying, e.g., with the Moving Picture Experts 

Group (MPEG) transmission standard) without decompress- In accordance with the present invention, a method and 

ing the data in the data stream, and while maintaining apparatus are presented for splicing a secondary packetized 

compliance with the MPEG or similar digital data commu- data stream, such as a commercial, with a primary pack- 

nication protocol. etized data stream, such as a network television program. 

Digital transmission schemes are particularly advanta- 15 Advantageously, the system does not require the decora- 

geous for signals that are broadcast from a main office by P ression of mc data in the P nmar y data stream > and 15 

satellite to a cable television affiliate at a system headend. At particularly suitable for use at a cable system headend, 

the system headend, the digital data stream may be further A start signal is provided to indicate the time to initiate the 

processed and distributed to the cable system customers, for 20 splicing, that is, when to insert the commercial. The start 

example, via a Hybrid Fiber Coax (HFC) or Fiber to the signal may be embedded as data in the main program, in 

Curb (FTTQ network. Such an arrangement is known as an which case it must be recovered. Alternatively, the cable 

end-to-end digital network since digital video is compressed system operator may provide an external time signal. In 

and transmitted from a programming source at a central either case, once the start signal has been received, a 

office all the way to each customer's home. In an HFC 25 pre-splicing packet of the primary stream is determined, 

network, a distribution line includes both a coaxial cable Normally, the pre-splicing packet is the packet closest to the 

which carries radio-frequency signals, and an optical fiber start time which carries an anchor frame start code. The 

which carries light wave signals. In a FTTC network, an anchor frame start code indicates that data of an I or P frame 

optical fiber carries the data stream from the cable system is carried in the packet. Typically, such a packet may carry 

headend to a neighborhood transfer point, or drop, and 30 data from the I (or P) frame, and the frame which immedi- 

conventional coaxial cable carries the signal from the drop ately precedes the I (or P) frame. To prevent a potential 

to the customer's home. At the customer's home, a decoder discontinuity at the decoder, the pre-splicing packet is 

processes the digital signal to provide a signal for display on processed to discard the anchor frame data, and to insert a 

a television or other display device. number of stuffing bytes which is equal to the number of 

In such cable distribution systems, the received data 35 b y tes discarded into an adaptation field of the pre-splicing 

stream may be processed at the headend prior to distribution P acket - An adaptation field is created if it does not already 

to the system customers. In particular, commercial messages exist. 

from local businesses may be inserted into the main pro- Additionally, to maintain continuity at the decoder, iden- 
grams. However, in order to accomplish this, conventionally tifying data of the primary stream such as PID and PSI data, 
the received digital data stream must be completely 4 o is retrieved and provided to the secondary stream, 
demodulated, demultiplexed, decrypted, decompressed and Furthermore, it may be necessary to insert a number of 
decoded to recover the signal in the analog domain. Then, null packets into the output stream at the transition point 
the desired commercial message is provided in the analog between the main program and the commercial. In 
domain and inserted into the signal to provide a new analog particular, a number L of null packets are provided in the 
combined signal. Finally, the analog combined signal is 45 output stream to prevent a buffer overflow at a decoder 
digitized, encoded, compressed, encrypted, multiplexed and which receives the output stream. The null packets are 
modulated for transmission to a customer's home. As can be inserted between the pre-splicing packet of the main pro- 
seen, this process leaves much to be desired as it requires a gram and the first packet of the commercial. Similarly, when 
number of time-consuming steps that must be implemented there is a transition back from the commercial to the main 
with additional hardware, including magnetic tape recorders 50 program, additional null packets may be inserted. The num- 
and players. Moreover, a large magnetic tape library must be ber L is determined according to the data rates of the primary 
maintained and indexed. Furthermore, the conversion from and secondary streams, and provides a corresponding pad- 
digital to analog and back to the digital domain may result ding delay time which reduces the decoder's buffer level, 
in degradation of the signal quality. Also, at the transition back from the commercial to the 
Thus, it would be desirable to provide a system for 55 main program, a post -splicing packet of the main program 
allowing an auxiliary compressed digital signal such as a which follows the pre-splicing packet is determined, 
commercial message to be inserted into a compressed digital Typically, the post-splicing packet will have a sequence start 
signal of a main program without requiring decompression code which follows the sequence end code which is asso- 
of the data in the main program signal. Such a system should ciated with the last packet of the commercial. The post- 
allow cable system headed operators to conveniently insert 60 splicing packet is positioned to follow the last packet of the 
commercial messages into a main program which is commercial in the output stream. Moreover, processing of 
received, for example, via a nationwide or international the post-splicing packet is analogous to processing of the 
satellite distribution network. Additionally, the system pre-splicing packet. Specifically, data in the post-splicing 
should not degrade the quality of the main program. In packet which is associated with an immediately preceding 
particular, the system should avoid any discontinuity which 65 packet, which may or may not be the same as the pre- 
results in a non-compliant data stream. The system should splicing packet, is discarded to prevent a discontinuity at the 
also preclude problems such as syntax violations, decoding decoder. Moreover, an amount of stuffing data is added to an 
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adaptation field of the post-splicing packet based on the FIGS. 14a and 14b show a post-splicing data packet 

amount that was discarded. An adaptation field is created if having no adaptation field or PES header before and after 

it does not already exist. processing in accordance with the present invention. 

A corresponding apparatus, including an insertion pro- _ m 

cessing module, is ako presented. 5 DETAILED DESCRIPTION OF THE 

INVENTION 

A decoder is also presented for decoding a transport data 

stream which comprises a main program and a commercial. A method and apparatus are presented for splicing a 

The decoder includes a buffer for storing the transport data. secondary packetized data stream, such as a commercial, 

The buffer has a size that is modeled at the insertion with a primary packetized data stream, such as a network 
processing unit by a virtual buffer scheme. A processor is 10 television program. 

coupled to receive data from the buffer for processing to FIG j ^ a block diagram of a Fiber-to-the-Curb Digital 

provide a signal which is routed to a television for display video Distribution Network in accordance with the present 

of the main program and the commercial, in turn. A number invention. The distribution network includes Video Infor- 

L of null packets are provided between a pre-splicing packet mation Providers (VIPs) shown generally at 100, a gateway, 
of the main program and a first packet of the commercial to 15 snown generally at 120, an access network, shown generally 

prevent overflow of the buffer. In particular, the number Lis at 140, and the home of a Video Information User (VIU), 

determined according to the respective data rates of the main shown generally at 160. The gateway 120 may comprise an 

program and the commercial. Additionally, L may be deter- L1 Gateway manufactured by Teleco. The VIPs may include 

mined according to a decoding delay time of the decoder, a vi deo serve,. 102, an interactive data server 104, and an 
and according to a padding delay which prevents a decoding 20 internet gateway 106, all of which communicate with an 

discontinuity. The decoder provides a signal for display on asynchronous transfer mode (ATM) network 122 via, for 

a display device such that a transition between the main example, an OC-3 system, where optical fiber is used to 

program and the commercial, and back again, is substan- transmit data at 155.52 Mbit/sec. The ATM network 122 

tially seamless. ^ mav ^0 receive data via a satellite receiving antenna 110, 

BRIEF DESCRIPTION OF THE DRAWINGS broadcast encoder and server 112, and ATM multiplexer 114. 

The ATM network 122 communicates with a session man- 

FIG. 1 is a block diagram of a Fiber-to-the-Curb Digital a g er 123. 

Video Distribution Network in accordance with the present ^ AJM netwofk m may pfovide information to one or 

invention. ^ more access networks, such as a cable television distribution 

FIG. 2 is a block diagram of a Hybrid Fiber Coax Digital headend 140. First, however, the information from the ATM 

Video Distribution Network in accordance with the present network is processed via a Digital Ad Insertion Module 

invention. (DAIM) 130 in accordance with the present invention. 

FIG. 3 is a block diagram of a Digital Ad Insertion Information, such as a network television program, passes 

Module in accordance with the present invention. 35 between the ATM network 122 and the DAIM 130 via an 

FIG. 4 is a block diagram of an Insertion Processing Unit ATM receiver (Rx) interface (I/F) 124. The DAIM 130 

of a Digital Ad Insertion Module in accordance with the receives the information as a compressed digital packetized 

present invention. data stream and accesses an inserted stream storage unit 135. 

FIG. 5 illustrates the processing flow of the Insertion The storage unit may include a digitized library of adver- 

Processing Unit of FIG. 4 in accordance with the present 40 tisements (e.g., commercials) which are available to insert 

invention. mt0 network television program. The storage unit 135 

FIGS. 6a to 6c are diagrammatic illustrations showing ™^ lude digital ^dio Upes (DATs), digital video disks 

how variable length PES packets are reorganized into fixed ( DVD f)' com P act audl ° dlscs < CDs ) or other ma S netlc or 

length transport packets for use in providing a transport optlcal stora 8 e media - 

multiplex for transmission. 45 In accordance with the present invention, the DAIM 130 

- FIGS. la-Id show a pre-splicing data packet having an inserts . a compiessed digital packetized advertisement 

adaptation field and PES header before and after processing stream int0 the «"nP"»sed dl 8 ltal packetized data stream of 

in accordance with the present invention. the network television program without decompressing the 

iTf^c o a ol u program. Moreover, when the television program is in an 

FIGS. Ha and Sb show a pre-splicing data packet having wnr:^ n • 1 * , ( , nuu 1- 

A t t . a. u . nro u ? « / j r 50 MPEG-2 or similar format, the DAIM maintains compliance 

an adaptation field but no PES header before and after t - t , t . XjfDn ~ ~> . 1 ™ um .u w a- 

. j .... . . with the MPEG-2 protocol. Or course, while the embodi- 

processing in accordance with the present invention. . f i ■ 1 1 . (J f 4 , , . c 

r o ment °* FIG. * ^ particularly suited for the insertion of 

FIGS. 9a-9d show a pre-splicing data packet having no advertisements into a network television program, there are 

adaptation field but with a PES header before and after many other ^rul applications, including the insertion of 

processing in accordance with the present invention. 55 educational programming, emergency messages such as 

FIGS. 10a and 10b show a pre-splicing data packet having weather bulletins, informational messages from the cable 

no adaptation field or PES header before and after process- system operator, and the like. Furthermore, audio only or 

mg in accordance with the present invention. data only messages may be inserted into the main packetized 

FIGS. lla-Ud show a post-splicing data packet having data stream. Moreover, the same message may be inserted 

an adaptation field and PES header before and after pro- 60 into more than one main program at the same time, and 

cessing in accordance with the present invention. different messages may be inserted into different main 

FIGS. 12a and 12b show a post-splicing data packet programs at the same time, 

having an adaptation field but no PES header before and A compressed digital packetized data stream which 

after processing in accordance with the present invention. includes the inserted message combined with the main 

FIGS. 13a-13d show a post-splicing data packet having 65 program is output from the DAIM 130 to an ATM trans- 
no adaptation field but with a PES header before and after mitter (Tx) interface 126, and then provided to an access 
processing in accordance with the present invention. network (e.g., cable system headend) 140. In the access 
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network 140, a Host Digital Terminal (HDT) 144 receives is provided to a Main Stream Parser (MSP) 415. The MSP 

the data stream and also receives control signals from an also receives an input labeled T_in, which is the desired 

element manager 142, which manages the cable network, starting time of the insertion of the insertion stream into the 

The HDT 144, which is a specialized digital switch which is mam stream. Similarly, after processing by the packet 

typically located in a head office of the cable system, 5 framer 410, the insertion stream is provided to an Insertion 

communicates with one or more Optical Node Units stream Parser (ISP) 420. The ISP also receives an input 

(ONUs), including ONU 146. The ONU is located in the labded T __ outj which ^ me desired ending time of the 

local curb and supports an optical to electrical conversion insertion of lhe insertkm stream int0 lhe main stream T _ in 

and modulation/demodulation. Tne ONU 146 then provides be carried ^ ^ main streamj Qr it ma be ided 

the data stream over a coax attribution network to one or 1Q ^ &uch ^ a( me qMq m headend similarl 

more subscriber s homes or offices. At each home a drop T out may be carried in the main stream, insertion stream, 

box 164 located near the home receives the combined digital Qr be enerated locally 

signal and provides it to a Digital Entertainment Terminal . 4 yl1 _ 4 . , 4 . t , iL 

(DET) (e.g., decoder) 168 and a Network Interface Module The , ma,n stre * m P a f r 415 P ar f es *e data packets of the 

NIM) 166. The DET decodes the packetized data stream, „ ™ m ^ eam and Provdes signals to a V1 deo buffer manager 

and the signal is seamlessly delivered for display to the 15 s J nals * ^ ram Clock Reference 

Video Information User (VIU) (e.g., subscriber) via televi- ( PCR )> a D « codm S Time Stam .P anda vldeo blt rate . 

sions 170, 172 and/or personal computer 174. R - v > f ° r „ the mai ° sl ^ am ' Similarly the insertion stream 

, , , ,. j? tti -jw-l ^ w^- i parser 420 parses the data packets of the insertion stream to 

' 2 . 18 .^l?ck diagram of a Hybrid Fiber Coax Digital £ rovide p C ' R , DTS , and £ v , ^ k tQ the videQ buffier 

Video Distribution Network in accordance with the present « n . r~ ° . . t 

. , . f , 2U manager 425. where the prime notation mdicates a param- 

mvention. Like -numbered elements correspond to the ele- . % . . ™ . , . „ i 1e 

* r ™„ * r-, j. A A . A i ■ i j eter or the insertion stream, i he video butter manager 425 

mentsof FIG, 1. The distribution network includes a satellite . . , . , . . , KT ° r n 

.... „ A . i it t uses the input signals to determine a number, N, ot null 

uplink, shown generally at 200, a satellite downlink, shown , . , . , . . . . . , «. , , , 

„ . n ,„ rT) , packets which will be inserted into the output data stream, 

generally at 240, an access network 140 and a VlU s home T *■ i * j j j u «■ Co % u 

-tm . i- i -i/w* • i j . - , In particular, to avoid a decoder butter overflow, it may be 

160. Trie satellite uplink 200 includes a broadcast encoder « c r „ , . , . 4 , « . J . 

a me f . , 1 25 necessary to add null packets to the output stream during the 

and server 205, which may also perform an encryption 4 r *u • * *u • *• ♦ j j • 

r . . , f . . - f transition from the mam to the insertion stream, and during 

function, an MPEG multiplexer 210. a modulator 215, and ... P . . , - c 

. *L„ ~ ... , ,. , the transition from the insertion to the main stream, if the 

a transmitting antenna 220. The satellite downlink 240 , . . . , , . t t 

b .. j , , . insertion stream has a higher data rate than the main stream, 

includes a receiving antenna 242, and an integrated receiver ™ , rut*- j j * ti i * 

^^jr™_ • i j , The number of null packets is provided to a null packet 

244. The signal received at the antenna 242 typically com- , n . , r „ ~ . „ & rr\n\ aos I- u • 

fT , f . . , / i. j j 30 generator 430 and then to a Data Buffer (DB) 485 which is 

prises a multiplex of encrypted channels (e.g., one hundred * f . #u ff ^ nr)/)0 . v 7 . . ... 

r t r ,Nr ■ v . • part ofan output buffer 475. The DB 485 communicates with 

or more channels) trom various programming service pro- a s ntax rocessor 470 

viders. The received multiplexed signal is processed at the 4 X P rocessor 

integrated receiver 244 by a demodulator 246 and decryp- ^ mam stream l J> !i l ! * r ?}? P™ 1 *™ 11,6 main *to«n.^ta 

tion function 246 lo a main stream buffer 480, which communicates with a 

rp, -t ' i . • i c , i ■ j j * 35 syntax processor 470. The main stream buffer 480 is part of 

The recovered multiplex ot channels is then provided to ' f t , ff ™_ ^. 4 A** n 

*u n/innenr ■ j - t . 4 . 4 the output buffer 475. The insertion stream parser 420 

the u AIM 25U tor processing in accordance with the present i ™ « 

t-u nm/ • . i . , provides the insertion stream data to a Program Specific 

invention. The DAIM accesses an inserted stream storage f c /T .^ 1X . r „ . 

, . j j ■ ** i i. j Information (PSI)/Program Identifier (PID) Replacer 435, 

unit 135 to retrieve a compressed digital packetized message ... . v /' . , r L . . 

r . . , * i_ i r.u if- which replaces the PSI tables and PIDs of the insertion 

tor insertion into one or more main channels ot the multi- 4 n t . flL . „ noimi „ . 

, AAa . , nAI w HU stream with those ot the main stream. The PSI/PID replacer 

plex. After processmg by the DAIM, the one or more . . 4 , . r . r . • 

u- j ■ i ju * ji-rAr 435 retrieves the relevant information from the mam stream 

combined signals are received by a transcoder 260 for . ... ...... , ™ 

jw /r t - i-r- 11 using a communication path which is not shown. The PSI 

encryption and/or modulation at function 265, as well , „ TT ^ , . r , 4 . . - 4 . 

t - »u . -ra. i.-i r * i • i j- .i_ ™ PID data of the main stream provide the information to 

known in the art. lhe multiplex ot signals, including the , r . , 

! . , . .7 j » ,i connect the various audio, video, and data packets to a 

signal with the inserted messages, is then received by the 4 « t . , . „ ' „ . 

access network 140 and transmitted to the subscribers' P"t>cular programmmg service. Specmcally, is aa:om- 

. c a* i 4 .. \7ittj i_ j- i * plisned using a Program Association lable (PAJ) and a 

homes for display at the VIU s home 160 as discussed in £ w & _ . . ™ ™ . v 7 . , 

** u mr i Program Map Table (PMT). The insertion stream is then 

connection With FIG. 1. -j j ♦ i c. r> cc Ann u- u ■ 

™„ „ . . c n . . , _ . provided to an Insertion Stream Buffer (ISB) 490, which is 

x*^ .' mfrL^ f am .u ,? lgl • ^ the output buffer 475. The ISB 490 communicates 

Module (DAIM) in accordance w.th the present invention. 50 with a synlax processor 470 , Furlhermore> the output buffer 

Advantageously, the DAIM 300 is compauble with existing m K ^ ^mmands from a buffer controller 465 to 

communication networks, including the Fiber-to-the-curb • . . * * -.u *u • #■ 

* j crrr 1 j n u ■ 1 r-i. . 1 r provide an output stream with the insertion stream seam- 
network of FIG. 1, and the Hybrid Fiber Coax network of il oc , , -„ tn t * m - ctroam 
t?t,~ -1 tu • • /wo\ t_* u lessly spliced into the main stream. 
FIG. 2. The DAIM receives a main stream (MS) which r , , , . , . , . 

comprises a primary data stream such as a network televi- 55 Further deta ^ n 0 A f ! * T?* -n u °! l T^ D 

sion program, and an insertion stream (IS), which comprises fusing unit 400 of FIG 4 wiU now be discussed. The 

a secondary data stream such as a commercial message. Allowing terms and variables will be used: 

Within the DAIM, an external control interface 310 com- IPU: Insertion Processing Unit— a unit inside the Digital 

municates with an Insertion Processing Unit (IPU) 400. Ad-Insertion Module. 

After the commercial message is inserted into the main eo Main Stream (MS): The incoming digital stream that 

stream, an output stream is produced. carries the normal digital video programming services. 

FIG. 4 is a block diagram of an Insertion Processing Unit Insertion Stream (IS): The digital stream segment that will 

(IPU) of a Digital Ad Insertion Module in accordance with De inserted into the main stream, 

the present invention. The IPU, shown generally at 400, Output Stream (OS): The outgoing main stream after 

receives the main stream at a packet framer 405, while the 65 insertion. 

insertion stream is received at another packet framer 410. T_in: The external signal indicating the desired starting 

After processing by the packet framer 405, the main stream time of the insertion in the main stream. 
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T_out: The external signal indicating the desired ending insertion stream into the main stream. Note that the terms 

time of the insertion in the main stream. "insertion stream," "secondary stream " or the like as used 

sp_in: The insertion starting position, or splicing start herein can denote replacement (e.g., overwriting) of packets 

point, in the main stream. It is generated internally by of toe main stream as well as insertion without loss of any 

the DAIM, and is not necessarily coincident with T_in. 5 main stream packets. However, this latter case will require 

sp_out: The insertion ending position, or splicing end a lar S e amou u n ! of memor y t0 store ? e / 0 ^ on ° f ^ & main 

point, in the main stream. It is generated internally by stream which ls ^Porarily suspended while the insertion 

the DAIM, and is not necessarily coincident with stK J™ 1S transrmtted - t 

T out If the main stream carries a plurality of programs, the IPU 

~ * . . . „ , . . io can insert the packets of the insertion stream into transport 

sp in : The starting position of the insertion segment in packets m ^ main ^ m ^ hc{QQg {Q Qne Qr mor£ 

the insertion stream. selected programs. In this case, the data rate of each elemen- 

sp_out': The ending position of the insertion segment in tary stream in the insertion stream should be the same as the 

the insertion stream. da t a ra tc of the corresponding programs in the main stream. 

MPEG: Moving Picture Experts Group for video, audio 15 For example, the rate of a video elementary stream in the 

and system coding format. insertion stream should be equal to the rate of the video 

TS: The MPEG Transport Stream which uses the 188 byte elementary main stream which is to receive the insertion 

packet format. data. The IPU processes the packets near the beginning and 

Null Packet: A transport packet that does not contain any end ° f the insertion 50 the resultin 8 stream is 

valid audio/video data. 20 compliant. 

f ii u main stream packet framer 405 receives a fully 

Number ot nul1 P ackets * compliant, unaligned MPEG-2 main transport stream at its 

PID: The Program IDentifier carried in each MPEG channel input. The main stream data is in a serial format. The 

transport packet indicating the presence of a data MPEG-2 transport packet synchronization byte may occur at 

stream. 25 any bit position. The packet framer 405 provides the trans- 

PSI: Program Specific Information carried in the transport port packet alignment, and outputs a transport stream which 

packet indicating the mapping of a group of PIDs to is aligned to the packet boundary. The insertion stream 

individual programs. It includes PAT/PMT. packet framer 410 performs a similar function for the 

PES: Packetized Elementary Stream is a layer of data insertion stream. 

carried by the TS. 30 Th e M am Stream Parser (MSP) 415 and Insertion Stream 

ES: Elementary Stream-can be video, audio, or data. Parse < ( ISP > 420 are used , to P alse the mam stream a f 

_ „ . _ e . . insertion streams, respectively. The stream parsers parse the 

PCR: Program Clock Reference-system clock time tive ali acA streams of me ket framers 405 and 

stamps wh.ch are carried in the mam stream. 410 from me (ransport , ayw tQ ^ pictul6 layer At a ^ 

PCR': Program Clock Reference— system clock time 35 prior to T_in, the MSP 41S bypasses the main stream in its 

stamps which are carried in the insertion stream. mput and send the stream directly to the main stream buffer 

DTS: Decoding Time Stamps indicating the decoding 480, and the ISP 420 parses the input insertion stream to 

time of each ES element in the main stream. locate the sequence start code. When a packet with a 

DTS': Decoding Time Stamps indicating the decoding sequence start code is detected in the insertion stream, the 

time of each ES element in the insertion stream. 40 ISP P uts the address of this packet into a register (not 

R_v: Video bit rate for the main stream. shown )* ^ address fe a read address for & & insertion 

n , , 7 ., . . - , . stream. 

R_v': Video bit rate for the insertion stream. . nc T ■ • Aa . an . aA , Ua XjfCD «u a m „ „ 

As soon as T__in is detected, the MSP parses the mam 

Sequence Header: The highest layer of header in a MPEG stream t0 locale the transport packet with the next, or most 

video stream. 45 recen t previous (if still available), anchor picture start code. 

GOP Header: Group of Pictures header— the second layer When an I or P picture start code is found in the main stream 

of header followed by a complete self-contained transport packets, the MSP 415 sends the transport packet 

sequence of pictures (e.g., frames), which contains the anchor picture start code (e.g., the last 

Picture Header: The header which precedes each picture. packet of the main stream) to the syntax processor 470 for 

I Picture: Intra-coded picture that can be decoded without 50 processing. Also at this time, the ISP 420 sends the first 

referring to another picture. packet of the insertion stream to the syntax processor 470 to 

P Picture: Forward predicted picture that can be decoded ^ "j^f or "repaired", as discussed below in greater 

using the previous decoded I or P picture. detaiL When a Vldc0 buffer venfier ( e g'» MPEG Parameter 

a i n- t in-. u * . "vbv_buffer") management is required, the MSP 415 and 

Anchor Picture: I or P pictures are anchor pictures since „ IC ri n i u ♦ *u no« htc 

t h~„ ~o., u~ ^ n „p™ ^ t * ,u 55 ISP 420 Wl11 also nave to P arse tne p CR, DTS, video rate 

they may be used as a reference to predict another „ 0 , , t . r . . ' i( _ 

picture — v or — v ' a 0 parameters as required, store them 

_ „. in the data buffer 485, and provide them to the video buffer 

B Picture: Bi-directionally predicted picture that can be manager 425 

decoded using the previous and next I or P decoded ^ VB v is a hvpothetical decoder which fe conceptually 

picture. Cannot be used as an anchor picture. 6Q connecled t0 the oulput of an encoder Coded dala is placed 

vbvjuffer: Virtual Buffer Venfier (VB V)— a conceptual in the buffer at the constant bit rate that is being used, and 

decoder channel buffer that shall not overflow or under- is removed according to which data has been in the buffer for 

A° w - the longest period of time. The bitstream produced by an 

R_t: Transport stream data rate. encoder or editor must not cause the VBV to either overflow 

The IPU 400 can process a main transport stream that 65 or underflow. The MSB 415 and ISB 420 output the same 

includes one or more programs (e.g., channels). If the main transport stream which appeared at the input after parsing as 

stream carries only a single program, the IPU inserts the discussed. 



02/12/2004, EAST Version: 1.4.1 



5,917,830 



10 



20 



25 



At the time T_out, the operation of the MSP and ISP is 
similar to the T_in point, except that the main stream and 
insertion stream are interchanged. That is, after the insertion 
stream has been inserted into the main stream, the main 
stream must be coupled with the end of the insertion stream. 5 
To accomplish this, as soon as T_out is detected, the ISP 
will parse the insertion stream to locate the transport packet 
with the next, or most recent previous (if still available), 
anchor picture start code. When an I or P picture start code 
is found in the insertion stream transport packets, the ISP 10 
420 sends the transport packet which contains the anchor 
picture start code (e.g., the last packet of the insertion 
stream) to the syntax processor 470 for processing. Also at 
this time, the MSP 415 sends the first packet of the remain- 
der of the main stream to the syntax processor 470 for 15 
processing. In this manner, the transition from the end of the 
insertion stream to the beginning of the remainder of the 
main stream can be performed seamlessly. 

The video buffer manager 425 checks for the fullness of 
the video buffer according to its inputs, PCR, PCR', DTS, 
DTS', and video data rates R_v and R__v\ In case of a 
potential buffer overflow, it instructs the null packet genera- 
tor 430 to generate L null packets and insert the packets into 
the output stream. The number of packets to generate is 
stored in a register. 

The syntax processor 470, which can communicate with 
the MSB 480, DB 485 and ISB 490 of the output buffer 475, 
processes the last packet before the splicing point and the 
first packet after the splicing point to provide a seamless 
transition that is MPEG compliant. At T__in, the syntax 30 
processor 470 reads the last transport packet from the main 
stream and the first packet from the insertion stream. It 
checks the syntax of the packets and repairs them, if 
necessary, so that they will be MPEG compliant, as will be 
discussed below in greater detail. At T_out, the syntax 35 
processor 470 operates in the similar way except that the 
main stream and insertion stream are interchanged. That is, 
the syntax processor 470 will read the last transport packet 
from the insertion stream and the first packet from the main 
stream, and then check the syntax of the packets and repair 40 
them, if necessary. Thus, the syntax processor 470 receives 
unfixed packets and addresses for the unfixed packets, and 
outputs fixed packets. 

In the event of potential buffer overflow, the null packet 
generator 430 is instructed by the video buffer manager to 45 
generate null packets and insert them to the output. Thus, the 
null packet generator 430 receives a signal to generate null 
packets, and the number L of packets to generate, and 
outputs null packets. 

It is desired that the PIDs of the resulting output stream do 50 
not change after the insertion. Accordingly, a PSI/PID 
replacer 435 is provided to replace the PSI tables and PIDs 
of the inserted stream with those of the main stream. The 
PSI/PID replacer 435 receives transport packets with the old 
PSI/PID, new PSI tables, and a PID conversion table, and 55 
outputs transport packets with the PSI/PID replaced. 

The output buffer 475 is divided into three parts. The Data 
Buffer (DB) 485 is used to store common data such as PSI 
and null packets. The Main Stream Buffer (MSB) 480 and 
Insertion Stream Buffer (ISB) 490 are used to store the main 60 
stream and insertion stream, respectively. 

A buffer controller 465 is used to coordinate the read and 
write operations of the DB, MSB, and ISB. It also performs 
addressing and output scheduling of each transport packet 
stored in the MSB, ISB and DB. 

A group of registers (not shown) is used in the system for 
storing various parameters such as packet addresses and N, 



the number of null packets. A map of registers which may be 
used in accordance with the present invention is given in 
Table 1, below. It should be appreciated that Table 1 is an 
example only, and any other suitable map could be used. In 
Table 1, the first column indicates the register index, the 
second column indicates the number of bits, the third 
column indicates whether read (R) and/or write (W) capa- 
bility is required, and the fourth column describes the 
function of the register location. 

TABLE 1 



65 



Index 


Bits 


R/W Description 


1 


7:0 


R,W Read address for main stream 


2 


7:0 


R,W Read address for main stream 


3 


7:0 


R,W Read address for main stream 


4 


7:0 


R,W Read address for main stream 


5 


7:0 


R,W Write address for main stream 


6 


7:0 


R,W Write address for main stream 


7 


7:0 


R,W Write address for main stream 


8 


7:0 


R,W Write address for main stream 


9 


7.0 


RjW Read address for insertion stream 


10 


7:0 


R,W Read address for insertion stream 


11 


7:0 


R,W Read address for insertion stream 


12 


7:0 


RjW Read address for insertion stream 


13 


7:0 


R,W Write address for insertion stream 


14 


7:0 


R,W Write address for insertion stream 


15 


7:0 


R,W Write address for insertion stream 


16 


70 


R,W Write address for insertion stream 


17 


70 


R,W PCR of current stream 


18 


70 


R,W PCR of current stream 


19 


7:0 


R,W PCR of current stream 


20 


70 


R,W PCR of current stream 


21 


70 


R,W PCR of current stream 


22 


70 


R,W PCR of current stream 


23 


7:0 


R,W DTS of current stream 


24 


7:0 


R,W DTS of current stream 


25 


7:0 


R,W DTS of current stream 


26 


7:0 


R,W DTS of current stream 


27 


7:0 


R,W DTS of current stream 


28 


7:0 


R,W Address for FAT 


29 


70 


R,W Address for PAT 


30 


7:0 


R,W Address for PAT 


31 


70 


R,W Address for PAT 


32 


70 


R,W Size of PAT in number of packets 


33 


7:0 


R,W Address for PMT 


34 


7:0 


R/W Address for PMT 


35 


7:0 


R,W Address for PMT 


36 


70 


R,W Address for PMT 


37 


7:0 


R/W Size of PMT in number of packets 


38 




Interrupt register. 




7 


R SS, Splicing signal. 1: SS is detected; 0: splicing 
processing done 




6 


R MSDj 1: Main stream done 




5 


R ISD, 1 : [nsertion stream done 




4 


R NPD, 1: Null packets done 




3 


R APF, 1: Anchor picture found 




2:0 


N/A Reserved 


39 


7:0 


R,W Number of Null packets to generate 


40 


7:0 


R,W Stream output read address 


41 


7:0 


R,W Stream output read address 


42 


7:0 


R,W Stream output read address 


43 


70 


R S W Stream output read address 


44 


7:0 


R,W Main video elementary stream rate 


45 


7:0 


R,W Main video elementary stream rate 


46 


70 


R,W Main video elementary stream rate 


47 


7.0 


R/W Insertion video elementary stream rate 


48 


7:0 


R/W Insertion video elementary stream rate 


49 


70 


R,W Insertion video elementary stream rate 


50 


70 


R/W PID1 of main stream 


51 


7:3 


R/W PID1 of main stream 


51 


70 


R,W PID2 of main stream 


52 


7:3 


R/W PID2 of main stream 


53 


70 


R,W PID3 of mainstream 


54 


7:3 


R,W PID3 of main stream 


55 


7:0 


R,W PID4 of main stream 


56 


7:3 


R/W PID4 of main stream 


57 


70 


R/W PID1 of insertion stream 
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Index 


Bits 


R/W Description 


58 


7:3 


R,W PID1 of insertion stream 


59 


7:0 


R,W PID2 of insertion stream 


60 


7:3 


R,W FID2 of insertion stream 


61 


7:0 


R,W PID3 of insertion stream 


62 


7:3 


R,W PID3 of insertion stream 


63 


7:0 


R,W PID4 of insertion stream 


64 


7:3 


R,W PID4 of insertion stream 


65-68 


7:0 


R,W Read address for PID1 of insertion stream 


69-72 


7:0 


R,W Write address for PID1 of insertion stream 


73-76 


7:0 


R,W Read address for PID2 of insertion stream 


77-80 


7:0 


R,W Write address for PID2 of insertion stream 


81-84 


7:0 


R,W Read address for PID3 of insertion stream 


85-88 


7:0 


R,W Write address for PID3 of insertion stream 


89-92 


7:0 


R,W Read address for PID4 of insertion stream 


93-96 


7:0 


R,W Write address for PID4 of insertion stream 
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Since B0=decoding__delay*R_v, we have: 
TABLE 1 -continued T_43ad^decoding__delay-vbv_buffer_size/R_v'. 

Since decoding_delay<vbv_buffer/R_v, to simplify the 
computation, T__pad can be written as: 

T_pad^vbv_buffer_size* (1/R_v-1/R__v'). 
For example, if R_v-4 Mbps and R_v'-8 Mbps, then the 
padding time will be: 
T_pad=l 835008 * (y4-VS)»0.23 sec. 
However, this does not mean that the viewer will detect a 
discontinuity of 0.23 second. In fact, there will be no visible 
discontinuity when the data is displayed on a television 
screen since the 0.23 second delay only flushes out part of 
the data in the video decoding buffer. After 0.23 second, the 
data from the insertion stream will fill the buffer while the 
decoder is still decoding the data from the main stream. As 
long as the time to decode the remaining data in the video 
decoding buffer is greater or equal to (vbv_delay_of_ 
The complexity of the IPU largely depends on the video first_picture— l/picture_rate) of the insertion stream, there 
buffer management scheme. Two implementations of a 20 will be no decoding discontinuity, 
video buffer management scheme in accordance with the Furthermore, at T„out, T_pad is computed as: 
present invention are presented. First, in a simplified T_pad^decoding_delay-vbv_buffer_size/R_v, or 

version, the number L of null packets for padding the output simplified to: 

stream to prevent buffer overflow are provided only accord- T_p ad ^ vb v_buff er__size * (1/R_v'-1/R_v) 

ing to the video elementary stream data rates of the main and ^ numbef of M kc[& N can therefore be 

insertion stream, R_v and R_v', respectively. At T_in, the computed as* 

number of packets to pad with null data is computed as: p * + // 1fifl +o\ 

I^vbv_buffer_size * (1/R_v-1/R__v') * R_t/(188*8). ™ J-f a .„ ♦ ♦ J! ■ « * ,u t ^ 

At T_out, the number of packets to pad is computed as: FIG " 5 Urates he processing flow of the Insertion 

I^vbv_buffer_size * (1/R_v'-1/R_v) * R_t/(188*8). Processing Unit of FIG. 4 in accordance with the present 
The advantage of this scheme is a simplified 30 invention. Note that the steps of FIG. 5 are shown as 
implementation, and there is no need to track the PCR and occurring in a sequential manner for clarity, but many of the 
DTS of the stream. The disadvantages are that padding is ste P s ma V occur concurrently and/or sequentially. At block 
larger than needed, and decoding or display discontinuities 502 ' IPU ^P^ the ™ m transport stream from the 
may result. Note that padding is required only when the main strcam buffer ( MSB ) 480 - ^ IPU 18 essentially in a 
insertion stream has a higher data rate than the main stream. 35 bv P a ss mode at this time since the insertion stream has not 

In a second, more complete version of the video buffer ^ et been inserted. At block 506, the main stream parser 
management scheme, padding is used according to a decod- the main streatn t0 locate the splicing signal T_in. 

ing delay of the main and insertion stream and the video Note that T - in need not be camed in the mam stream ' but 
elementary stream rates. The decoding delay is the differ- ma y be Provided locally, for example, at a cable system 
ence between the time the first byte of a picture is received 40 headend. When T_m is detected, the IPU continues to 
and the time when decoding is completed. With this scheme, 0Ut P ut the mam transport stream from the mam stream 
at T_in, the number of packets to pad is computed as: buffer At block 508 > the main stream P 3 ^ P arses tbe maul 

L-(decoding_delay-vbv_buffer_size/R_v') * R_t/ f ream t0 locate tbe closest pactet with an anchor picture 
n88*8^ ( e S » * or Ppi cmre ) start code and passes that packet to the 

At T_out, the number of packets to pad is computed as: 45 ^ ? socessot i 70 " This P^ cke ' wiU b , e . the ! ast P acket of 

, t , | , . a, Iri \ * n t/ the mam stream. To ensure that the resulting data stream is 

L-(decodmg delay-vbv buffer size/R v) * R t/ w™-,^ i* , j . r * * 

n rs*^ — — — — ~~ MPEG compliant, no data from the next rrame or sequence 

rj-r a \ f lL . , , . . - of frames may be included in this last main stream packet. 

The advantages of this second embodiment are that pad- AiL1 ,. n ; tL t j j 

j. « * , - , , r c At block 512, the syntax processor adds a sequence end code 

dine is used only as needed, and there is no chance ot a n , t , , , ' : A - . ™? , 

j , j. . # . . ... jl 50 field to the last packet or the main stream. Phe sequence end 

decoding or display discontinuity caused by padding. A ,. A / - , , ^ , f 

j. j ♦ * £ /*u j i • i i A r . . code is a twenty-four bit code which indicates the end oi a 

disadvantage is that the decoding delay must be computed, seauence of „ ic f ures At block 514 the psiypm renlacer 435 
and therefore the PCR and DTS of the data stream must be A \ A f . T, OTmTTA fiL • ^- . 

, j . j j mi • . j . , . t . , starts to replace the PSI/PID ot the insertion stream, 

retrieved and decoded. This requires additional hardware . . . « m-% s ,i ' A , r, A 

. At block 516, the syntax processor processes the first 

and expense 

„,./ ..." - , . . i i t . c 55 packet of the insertion stream (e.g., the packet which con- 

With either of the above schemes, the calculation of the f . 4l _ 4 4 J^ ^ L. J i t-^ »i_ 

, c ii ..• 1 . i_ . j . ,( tains the sequence start code) so that any data before the 

number ot null padding packets can be computed using the ^ , . it _. , 4 4t _ A . c t . 

f „ . , £ r. j . r ° sequence start code in this packet that is coming from the 

rollowing definitions and assumptions. . . , ... . . . , 

Definitions- insertion stream is replaced with stuffing bytes in the adap- 

, . , , , , , tation field. If the adaptation field does not exist, it is created. 

B0: Video decoding buffer size at the end of old stream. 6Q ^ packet > s transpoft header and pE§ headef afe ^ 

vbv_buffer size: 1 75 Mb or 1835008 bit modified to ensure that the output stream is MPEG compli- 
T_pad: Duration of null padding bits. a nt. The syntax processor also sets the discontinuity indica- 
nt T__in point: tors 0 f tne insertion stream in ISB for all the packets before 
B0-R_v * T__pad+(R_v'-R_v)*(decoding_delay-T_ the PCR packet to "1". 

pad) ^ vbv_buffer„size; and 65 At block 518, the video buffer manager 425 calculates the 

T_pad^decoding_delay* (l-R_v/R_v')-(vbv_ number, N, of null packets to pad. At block 520, at the end 

buffer_size-B0)/R_v'. of the main stream, which is designated as the position 
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sp__in, an interrupt signal, Main Stream Done (MSD), is p.m., T__out=8:01 p.m., then T_in«8:20 p.m., T_out=8:21 

generated. At block 522, after receiving the MSD signal, the p.m., and finally T_in-8:59 p.m., T_out-9:00 p.m. Other 

IPU reads the null packets from the data buffer 435 and variations are possible, of course. For example, a prere- 

writes the null packets to the output stream. At block 524, at corded series of commercials may be assembled. In this 

the end of the null packets, an interrupt signal, Null Packets 5 case, the beginning of the first commercial will correspond 

Done (NPD), is generated. to T__in, and the end of the last commercial may correspond 

At block 526, after receiving the NPD signal, the system to T_out. Alternatively, the network program may include 

begins to output data from the insertion stream buffer 490 at one or more commercials already in the main transport 

a position which is designated sp__in\ At the same time, the stream. In this case, the present invention may be used to 

MSP reads from the main stream and puts a new sequence 10 replace selected ones of the main stream commercials, or to 

in the MSB. remove selected ones of the commercials without replace - 

At block 530, when T_out is detected, the processing ment. Note that the latter case may not be possible in 

continues at block 540. Otherwise, the system is in a waiting real-time. 

mode until T_out is received. At this time, the system In order to implement the processing flow of FIG. 5, the 
continues to output data from the ISB. Generally, T_out 15 structure of a packetized data stream must be examined in 
may be provided locally, for example, by a cable system greater detail. In a packetized digital data stream, typically 
headend. However, it may be preferable for T__in and T__out the packets carrying the compressed video data will be 
to be provided in the main stream so that the cable headend multiplexed with other packets, e.g., carrying corresponding 
is not tasked with managing the time and duration of the audio data and control information necessary to reconstruct 
insertion. Moreover, the gap in the main stream in which the 20 a television signal. One standard for transporting digital 
insertion stream is to be provided will not typically be television signals in this manner is the MPEG-2 standard, 
controllable by the cable headend. At block 540, the ISP details of which can found in document AVC-491, version 1, 
parses the insertion stream for the packet with an anchor April, 1993, published by the Telecommunications Stan- 
picture start code and passes that packet to the syntax dardization Sector, Study Group 15, Experts Group 4ATM- 
processor. This will be the last packet of the insertion stream. 25 Video Coding of the International Organization for 
The syntax processor processes this last packet of the Standardization, ISO-IEC/JTC1/SC29/WG11 entitled 
insertion stream so that there is no data from the next frame "Coded Representation of Picture and Audio Information/* 
or sequence of frames included in the packet. Thus, the incorporated herein by reference; ISO/IEC 13818-2, Mar. 
resulting data stream will be MPEG compliant. At block 25, 1994, entitled "Generic Coding of Moving Pictures and 
544, the syntax processor adds a sequence end code field to 30 Associated Audio," incorporated herein by reference; and 
the last packet of the insertion stream. ISO/IEC 13818-1, Apr. 27, 1995, entitled "Coding of Audio, 

At block 546, the syntax processor processes the first Picture, Multimedia and Hypermedia Information," incor- 

packetof the main stream (which contains the sequence start porated herein by reference. Further details of the video 

code) so that any data before the sequence start code in this syntax and semantics for MPEG-2 video can be found in 

packet that is coming from main stream is replaced with 35 International Organization for Standardization document 

zeros. The packet's transport header and PES header are also ISO/IEC 11172-6 dated Apr. 2, 1993 and entitled "Revised 

modified to ensure that the output stream is MPEG compli- Syntax and Semantics for MPEG-2 Video," also incorpo- 

ant. The syntax processor also sets the discontinuity indica- rated herein by reference. Also of interest, and incorporated 

tors of the main stream in the MSB for all the packets before herein by reference, is document MC68VDP/D, a prelimi- 

the PCR packet to "1". 40 nary data sheet entitled "MPEG-2/DCII Video Decompres- 

At block 548, the video buffer manager calculates the sion Processor/* ©Motorola Microprocessor and Memory 

number of null packets to pad. At block 550, at the end of Technologies Group, 1994 which describes a video decom- 

IS, which is designated sp__out', an interrupt signal, Inser- pression processor using the MPEG-2 and DigiCipher®II 

tion Stream Done (ISD), is generated. At block 552, after standards. 

receiving the ISD signal, the system reads the null packets 45 In the MPEG-2 system (and the similar DigiCipher® II 

from the data buffer and writes to the output stream. At block system proprietary to General Instrument Corporation, the 

554, at the end of the null packets, an interrupt signal, Null assignee hereof) a transport stream, or transport multiplex is 

Packets Done (NPD), is generated. At block 556, after made up of a contiguous set of fixed length packets. Each 

receiving the NPD signal, the system begins to read from the packet is 188 total bytes in length, with the first four of those 

MSB at a point which is designated sp_out. Thus, at this 50 bytes being defined as the packet header. The payload 

time, the insertion stream ends and the next portion of the portion of each packet is thus normally 184 bytes. However, 

main stream begins to be output. At the same time, the ISP a variable length adaptation field may be provided to extend 

reads from the insertion stream and puts a new sequence in the header, when required. When an adaptation field is 

the ISB for future use. The process continues at block 506, present, the payload portion of the packet will be corre- 

where the MSP parses the main stream for the next splicing 55 spondingly snorter. 

signal, T_in. Various timing and identification information is provided 
In practice, the invention is particularly suitable for insert- in different portions of the transport stream. These include a 
ing commercial messages into one or more network televi- packet identifier (PID) found in the transport header of each 
sion programs. For example, often times a network program transport packet to provide a reference number for identi- 
is transmitted via satellite to local cable system operators. 60 fying the transport packets carrying a specific service com- 
The cable system operator has the task of inserting com- ponent. This number is included in a service definition or 
mercials from local businesses into the main stream. In this "service map" used by the receiver to identify those trans- 
case, it may be desirable to provide commercials, for port packets required to reconstruct a television program 
example, every twenty minutes. Furthermore, assume one signal. The PID may also be referenced for various groom- 
commercial is inserted, and that the commercial has a 65 ing and remultiplexing functions. In the case of video, audio 
duration of one minute. Then, for a network program which or isochronous control data, the stream of packets labeled 
runs from 8:00 p.m. to 9:00 p.m., we may have T_in=8:00 with a single PID represents a single video, audio or 



02/12/2004, EAST Version: 1.4.1 



5,917,830 

15 16 

isochronous data service elementary stream, respectively. evaluating whether timing and buffer control are operating 

Each type of packet will have a different PID identifying the properly at the decoder 

packet type. The DTS is a field indicating what value corresponding 

Timing information carried by the transport stream bits of the decoder system time clock reference should have 

includes a program clock reference (PCR) which effectively 5 when the decoder starts to decode the first access unit that 

represents a sample of the system time clock (STC) time starts somewhere in the pay load of this PES packet. The PTS 

base that underlies the service composed of the PIDs refer- and DTS differ only for video, and only in the case of the 

enced in the service map. The PID carrying the packet with I-frame and the P-frames transmitted with B-frames. 

the PCR is also referenced in the service map. The video, The PES payload contains the information data that is 

audio and isochronous data components of a service are id desired to be transmitted to a receiver. Thus, the payload 

locked through a defined relationship to the system time includes all of the video, audio and control information 

clock. The PCR serves to define the transport rate, in the necessary for the receiver to decode and reconstruct, e.g., a 

sense that between any two successive PCRs in one PID, the digital television signal. 

transport rate is constant and nominally equal to the system In order to meet the requirements of robustness and 
time clock rate times the ratio of the total number of 15 simplicity, a fixed packet length approach is preferred to the 

transport bytes between the PCRs divided by the difference variable length PES packets. Thus, as illustrated in FIG. 6b, 

in the PCRs in units of system time clock ticks. the packet elementary stream containing the PES packets 

The timing information carried by the transport stream 670 is reconfigured into a stream of fixed length transport 

also includes time stamps for the commencement of decod- packets 680. The transport packets illustrated in FIG. 62? all 

ing and presentation of data for display. The presentation 20 correspond to the same service component, such as the video 

time stamp (PTS) is used for service component acquisition component of a digital television transmission. In the 

and also for evaluating whether timing and buffer control are MPEG-2 and DigiCipher® II embodiments, each packet is 

operating properly at the decoder. The decoder time stamp 188 total bytes in length, with the first four bytes comprising 

(DTS) is used to indicate when the decoder should start to a transport packet header (TP HDR) 682. The payload 

decode the first access unit (e.g., video frame) that starts in 25 portion 684 of each packet 680 is thus normally 184 bytes, 

the payload of a packetized elementary stream (PES) packet However, an adaptation field mechanism is present, as 

whose header includes the DTS. A packetized elementary illustrated by transport packet 680', to extend the header 

stream is a data stream composed of end-to-end PES packets when required. The adaptation field 686 provides additional 

which have variable length and are typically far longer than information which is not required for every transport packet, 

a fixed length transport packet. Thus, a PES packet is 30 The adaptation field (ADPT FIELD) 686 extends the regular 

typically composed of data from a plurality of transport transport header 682 at the expense of payload 684, which 

packets. will be less than 184 bytes whenever the adaptation is 

FIGS. 6a to 6c are diagrammatic illustrations showing provided. The adaptation field 686 is of variable length, 

how variable length PES packets are reorganized into fixed depending on the information it contains. Typically, the 

length transport packets for use in providing a transport 35 adaptation field will support additional information for time 

multiplex for transmission. FIG. 6a illustrates a portion of a base recovery and other functions, and also provides a 

packetized elementary stream carrying successive PES mechanism for padding the payload when it does not occupy 

packets, each having a header (PES -HDR) 672 and a PES the full 184 bytes. Such padding can be used, for example, 

payload 674. The PES packets 670 are of variable length. to make a variable rate video packetized elementary stream 

PES packets are typically several thousand bytes in length. 40 into a constant rate transport stream. 

They are required to be aligned in such a manner that, when As indicated in FIG. 6b , the transport header of each 

divided into transport packet payloads, the first byte of every transport packet includes the PID which identifies the par- 

PES header is located in the first payload position of some ticular service component carried by the transport packet, 

transport packet. For any transport packet carrying the The PCR will be carried by an adaptation field to provide 

aligned PES header, a "payload unit start indicator" will be 45 timing information for a desired service. At a receiver, the 

set in the transport header for the transport packet. In the PCR for the desired service is detected from the adaptation 

MPEG-2 and DigiCiphero® II systems, the PES format is field. The PIDs of the transport packets will then be moni- 

used for all service components that are inherently synchro- tored in accordance with the timing established by the PCR 

nous. More particularly, video, audio and isochronous data to recover those transport packets carrying a particular 

components are carried as packetized elementary streams, 50 component of the service to be processed, 

and the PES headers 672 will carry various information Transport packets from various service components are 

necessary to define the payload, including a packet start code multiplexed into a transport multiplex 690 as illustrated in 

prefix, a stream identification, and a PES packet length. FIG. 6c. The transport multiplex will carry interspersed 

The header may also contain a presentation time stamp packets from each of the different components (e.g., video, 

(PTS) or decode time stamp (DTS). The PTS is a field which 55 audio and control) necessary to reconstruct a service at the 

indicates the value that corresponding bytes of the decoder receiver. In the illustrative transport multiplex shown in FIG. 

system time clock reference should have when the first 6c, video tr anspo rt packe ts 680 (A n , A 2 , A 3 . ..) are folio wed 

presentation unit (i.e., video frame, audio sync frame, iso- by audio components 692 (B 1 , B 2 , B 3 . . . ) which, in turn, 

chronous data access unit) whose access unit starts some- are followed by control component packets 694 (C lf C 2 , 

where in the payload of this PES packet is presented. For 60 C 3 . . . ). 

video, an access unit starts if the first byte of the picture start With the foregoing in mind, the operation of the syntax 

code is present in the payload of the PES packet. For audio, processor 470 of the IPU 400 in fixing the packets of the 

an access unit starts if the first byte of the sync word is main stream or the insertion can now be discussed. First, the 

present in the payload of this PES packet. For isochronous process of blocks 508 and 540 will be discussed, wherein the 

data, an access unit starts if the first byte of the data header 65 last packet of the main or insertion stream, respectively, 

is present in the payload of this PES packet. The PTS field before the splicing point, is processed to maintain compli- 

is used for service component acquisition, and also for ance with an MPEG or similar communication protocol. The 
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splicing point is the boundary between the main and inser- Here, there is data between the pes_hdr 704 and the 

tion stream packets. This corresponds to the point between pic_start__code 706, but not between the adaptation_field 

sp_in of the main stream and sp_in' of the insertion stream 702 and the pes_hdr 704. In accordance with the present 

when the output stream transitions from the main to the invention, the packet 740 is processed by discarding the data 

insertion stream, or to the point between sp_out* of the 5 of the pic__start__code 706 and the third data field 707, and 

insertion stream and sp_out of the main stream when the stuffing 4+M dummy bytes in the adaptation field 702. This 

output stream transitions from the insertion to the main results in the processed packet 750 which includes the 

stream. adaptation field 752, and which terminates with the second 

Generally, the last packet of the data stream before the data field 705. 

splicing point has to be processed since the transport packet 10 In FIG. Id, the unprocessed packet is shown generally at 

boundary may not be the same as the picture boundary. This 760. Here, there is no data field between the pes_hdr 704 

last packet will be referred to as a pre -splicing data packet. and the pic__start__code 706, or between the adaptation 

In this case, the pre -splicing packet will contain part of the field 702 and the pes__hdr 704. In accordance with the 

data from the next (anchor) frame. The pre -splicing packet present invention, as shown at 770, the entire packet 760 is 

can be fixed by discarding the data from the next frame and 15 not transmitted since there would be no data fields remaining 

stuffing the same amount of bytes to the adaptation field of after discarding the third data field 707. 

the last packet, where it is understood that stuffing bytes are FIGS. 8a and Sb show a pre-splicing data packet having 

simply dummy bytes of data. If an adaptation field does not an adaptation field but no PES header before and after 

exist in the last packet, it can be created. Note that after processing in accordance with the present invention. In FIG. 

fixing the information contained in the adaptation_field and 20 8cz, the unprocessed packet is shown generally at 800, and 

pes_hdr, including adaptation__field_length, payload_ the processed packet is shown generally at 810. Here, there 

unit_start__indicator, pes_length, and other parameters, is data between the adaptation field 802 and the pic_start_ 

may be changed. However, this is not expected to result in code 804, In accordance with the present invention, the 

any visible discontinuity or artifacts to the viewer when the packet 800 is processed by discarding the data of the 

data is displayed. 25 pic_start__code 804 and the second data field 805, and 

Processing of the pre-splicing packet is treated differently stuffing 4+M dummy bytes in the adaptation field 802. This 

depending on whether the packet has an adaptation field and results in the processed packet 810 which includes the 

a PES header, and further depending on the location of data adaptation field 812, and which terminates with the first data 

fields in the packet. FIGS. la-7d show a pre-splicing data field 803. 

packet having an adaptation field and PES header before and 30 In FIG. 8b, the unprocessed packet is shown generally at 

after processing in accordance with the present invention. 820. Here, there is no data field between the adaptation field 

In FIG. la, the packet, shown generally before processing 802 and the pic__starL_code 804. In accordance with the 

at 700, includes a transport header 701, an adaptation field present invention, as shown at 830, the entire packet 820 is 

702 carrying K bytes, a first data field 703, a PES header not transmitted since there would be no data fields remaining 

(pes_hdr) 704, a second data field 705, a picture start code 35 after discarding the second data field 805. 

706 carrying four bytes, and a third data field 707 carrying FIGS. 9a-9d show a pre-splicing data packet having no 

M bytes. In this case, it can be seen that there is data carried adaptation field but with a PES header before and after 

in the packet 700 between the adaptation_field 702 and the processing in accordance with the present invention. In this 

pes_hdr 704, and between the pes_hdr 704 and the pic_ case, an adaptation field is created which carries the dummy 

start_code 706. 40 stuffing bits which account for the discarded fields. In FIG. 

Moreover, since the pic_start_code 706 defines the start 9a, the packet, shown generally before processing at 900, 

of a new picture or frame, it can be seen that the third data includes a transport header 901, a first data field 902, a PES 

field 707 carries data of the new frame. Thus, in accordance header 903, a second data field 904, a picture start code 905 

with the present invention, the packet 700 is processed by carrying four bytes and a third data field 906 carrying M 

discarding the data of the pic_start_code 706 and the 45 bytes. In this case, data is carried between the tp_hdr 901 

associated third data field 707, and stuffing 4+M dummy and the pes_hdr 903, and between the pes_hdr 903 and the 

bytes in the adaptation field 702. This results in the pro- pic_start__code 905. In accordance with the present inven- 

cessed packet 710 which includes the adaptation field 712, tion the packet 900 is processed by discarding the data of the 

and which terminates with the second data field 705. The pic_start__code 905 and the third data field 906, and creat- 

packet 710 includes data from only one picture and does not 50 ing an adaptation field 912 with 4+M dummy bytes as shown 

require the next adjacent packet to maintain continuity. in the processed packet 910. 

Note that in FIGS. 7-11, the relative width of a packet or In FIG. 9b, the unprocessed packet is shown generally at 

a field thereof does not necessarily indicate the amount of 920, and the processed packet is shown generally at 930. 

data carried in the field or the packet. Here, there is data between the tp_hdr 901 and the pes_hdr 

In FIG. lb, the unprocessed packet is shown generally at 55 903, but not between the pes_hdr 903 and the pic_start_ 

720, and the processed packet is shown generally at 730. code 905. In accordance with the present invention, the 

Here, there is data between the adaptation_field 702 and the packet 920 is processed by discarding the data of the 

pes_hdr 704, but not between the pes_hdr 704 and the pes_Jidr 903, pic_start_code 905, and the third data field 

pic_start_code 706. In accordance with the present 906, and creating an adaptation field 932 with N+4+M 

invention, the packet 720 is processed by discarding the data 60 dummy bytes, as shown in the processed packet 930. 

of the pes_hdr 704, pic_start__code 706 and the third data In FIG. 9c, the unprocessed packet is shown generally at 

field 707, and stuffing N+4+M dummy bytes in the adapta- 940, and the processed packet is shown generally at 950. 

tion field 702. This results in the processed packet 730 which Here, there is data between the pes_hdr 903 and the 

includes the adaptation field 732, and which terminates with pic__start_code 905, but not between the tp_hdr 901 and 

the first data field 703. 65 the pes_hdr 903. In accordance with the present invention, 

In FIG. 7c, the unprocessed packet is shown generally at the packet 940 is processed by discarding the data of the 

740, and the processed packet is shown generally at 750. pic_start_code 905 and the third data field 906, and creat- 
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ing an adaptation field 952 with 4+M dummy bytes, as the second data field 1105 carry data of a picture from a 

shown in the processed packet 950. previous sequence. Thus, in accordance with the present 

In FIG. 9d, the unprocessed packet is shown generally at invention the packet 1100 is processed by discarding the first 

960. Here, there is no data field between the tp__hdr 901 and data field HO and the second data field 1105, and stuffing 

the pes_hdr 903, or between the pes_hdr 903 and the 5 N+M dummy bytes in the adaptation field 1102. This results 

pic__start_code 905. In accordance with the present in the processed packet 1110 which includes the adaptation 

invention, as shown at 970, the entire packet 960 is not field 1112. The packet 1110 includes data from only one 

transmitted since there would be no data fields remaining sequence of pictures and does not require the previous 

after discarding the third data field 906. adjacent packet to maintain continuity. 

FIGS. 10a and 106 show a pre-splicing data packet having In FIG. life, the unprocessed packet is shown generally at 

no adaptation field or PES header before and after process- 1120, and the processed packet is shown generally at 1130. 

ing in accordance with the present invention. In this case, an Here, there is data between the adaptation__field 1102 and 

adaptation field is created which carries the dummy stuffing the pes_hdr 1104, but not between the pes_hdr 1104 and 

bits which account for the discarded fields. In FIG. 10a, the the seq_start_code 1106. In accordance with the present 

unprocessed packet is shown generally at 1000, and the invention, the packet 1120 is processed by discarding the 

processed packet is shown generally at 1010. Here, there is 15 first data field 1103, and stuffing N dummy bytes into the 

data between the tp_hdr 1001 and the pic_start_code adaptation field 1102. This results in the processed packet 

1003. In accordance with the present invention, the packet 1130 which includes the adaptation field 1132. 

1000 is processed by discarding the data of the pic start In FIG. 11c, the unprocessed packet is shown generally at 

code 1003 and the second data field 1004, and creating an 1140, and the processed packet is shown generally at 1150. 

adaptation field 1012 with 4+M dummy bytes, as shown in 20 Here, there is data between the pes__hdr 1104 and the 

the processed packet 1010. seq_start_code 1106, but not between the adaptation_field 

In FIG. 10b, the unprocessed packet is shown generally at 1102 and the pes_hdr 1104. In accordance with the present 

1020. Here, there is no data field between the tp_hdr 1001 invention, the packet 1140 is processed by discarding the 

and the pic_start_code 1003. In accordance with the second data field 1105, and stuffing M dummy bytes in the 

present invention, as shown at 1030, the entire packet 1020 25 adaptation field 1102. This results in the processed packet 

is not transmitted since there would be no data fields 1150 which includes the adaptation field 1152. 

remaining after discarding the second data field 1004. In FIG. lid, the unprocessed packet is shown generally at 

Now, the process of blocks 516 and 546 will be discussed, 1160. Here, there is no data field between the pes_hdr 1104 

wherein the first packet of the main stream after the second and the seq_start__code 1106, or between the adaptation_ 

splicing point (e.g., sp_out), is processed to maintain com- 3D field 1102 and the pes_hdr 1104. In accordance with the 

pliance with the MPEG or similar communication protocol. present invention, the entire packet 1160 is transmitted 

This first packet will be referred to as a post-splicing data without modification since there is no data field prior to the 

packet. As with the pre-splicing packet, processing of the seq_start_code 1106. 

post-splicing packet is treated differently depending on FIGS. 12a and 12b show a post-splicing data packet 

whether the packet has an adaptation field and a PES header, 35 having an adaptation field but no PES header before and 

and further depending on the location of data fields in the after processing in accordance with the present invention. In 

packet. In particular, the first post-splicing packet must be FIG. 12a, the unprocessed packet is shown generally at 

processed by the syntax processor 470 when the splicing 1200, and the processed packet is shown generally at 1210. 

point does not correspond exactly to a picture boundary. In Here, there is data between the adaptation field 1202 and the 

this case, the post-splicing packet may contain part of the 40 seq_start__code 1204. In accordance with the present 

data from a previous picture or sequence of pictures. invention, the packet 1200 is processed by discarding the 

In accordance with the present invention, the post- first data field 1203 and stuffing N dummy bytes in the 

splicing packet is fixed by discarding the data from the adaptation field 1202. This results in the processed packet 

previous sequence and stuffing a compensating number of 1210 which includes the adaptation field 1212. 

dummy bytes to the adaptation field of the post-splicing 45 In FIG. 12b, the unprocessed packet is shown generally at 

packet. Furthermore, an adaptation field is created if it does 1220. Here, there is no data field between the adaptation 

not already exist. Moreover, as with the processing of the field 1202 and the seq_start_code 1204. In accordance with 

pre-splicing packet, the information contained in the the present invention, the entire packet 1220 is transmitted 

adaptation field and pes_hdr, including adaptation field_ without modification since there is no data field prior to the 

length, payload„unit_start_indicator, pes_length, and 50 seq_jstart_code 1204. 

other parameters, may be changed, but this is no expected to FIGS, 130-130* show a post-splicing data packet having 

result in any visible discontinuity or artifacts to the viewer no adaptation field but with a PES header before and after 

when the data is displayed. processing in accordance with the present invention. In FIG. 

FIGS, lla-llo" show a post -splicing data packet having 13a, the packet, shown generally before processing at 1300, 

an adaptation field and PES header before and after pro- 55 includes a transport header 1301, a first data field 1302 

cessing in accordance with the present invention. In FIG. carrying N bytes, a PES header 1303, a second data field 

11a, the packet, shown generally before processing at 1100, 1304 carrying M bytes, a sequence start code 1305 and a 

includes a transport header 1101, an adaptation field 1102 third data field 1306. In this case, it can be seen that there is 

carrying K bytes, a first data field 1103 carrying N bytes, a data carried in the packet 1300 between the tp__hdr 1301 and 

PES header, pes_hdr 1104, a second data field 1105 carrying 60 the pes_hdr 1303, and between the pes__hdr 1303 and the 

M bytes, a sequence start code 1106 and a third data field seq__start_code 1305. In accordance with the present inven- 

1107. In this case, it can be seen that there is data carried tion the packet 1300 is processed by discarding the first data 

between the adaptation_field 1102 and the pes_hdr 1104, field 1302 and the second data field 1304, and creating an 

and between the pes„hdr 1104 and the seq_start_code adaptation field 1312 with N+M dummy bytes as shown in 

1106. 65 the processed packet 1310. 

Moreover, the seq_start__code 1106 defines the start of a In FIG. 136, the unprocessed packet is shown generally at 

new sequence of pictures, and the first data field 1103 and 1320, and the processed packet is shown generally at 1330. 
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Here, there is data between the tp_hdr 1301 and the 
pes__hdr 1303, but not between the pes_hdr 1303 and the 
seq_start__code 1305. In accordance with the present 
invention, the packet 1320 is processed by discarding the 
first data field 1302, and creating an adaptation field 1322 
with N dummy bytes, as shown in the processed packet 
1330. 

In FIG. 13c, the unprocessed packet is shown generally at 
1340, and the processed packet is shown generally at 1350. 
Here, there is data between the pes_hdr 1303 and the 
seq_start_code 1305, but not between the tp__hdr 1301 and 
the pes_hdr 1303. In accordance with the present invention, 
the packet 1340 is processed by discarding the second data 
field 1304, and creating an adaptation field 1352 with M 
dummy bytes, as shown in the processed packet 1350. 

In FIG. 13d, the unprocessed packet is shown generally at 
1360. Here, there is no data field between the tp_hdr 1301 

and the pes_hdr 1303, or between the pes hdr 1303 and the 

seq_start_code 1305. In accordance with the present 
invention, the entire packet 1360 is transmitted without 
modification since there is no data field prior to the seq_ 
start_code 1305. 

FIGS. 14a and 146 show a post-splicing data packet 
having no adaptation field or PES header before and after 
processing in accordance with the present invention. In this 
case, an adaptation field is created which carries the dummy 
stuffing bits which account for the discarded fields. In FIG. 
14a, the unprocessed packet is shown generally at 1400, and 
the processed packet is shown generally at 1410. Here, there 
is data between the tp_hdr 1401 and the seq_start_code 
1403. In accordance with the present invention, the packet 
1400 is processed by discarding the first data field 1402, and 
creating an adaptation field 1412 with N dummy bytes, as 
shown in the processed packet 1410. 

In FIG. 146, the unprocessed packet is shown generally at 
1420. Here, there is no data field between the tp_hdr 1401 
and the seq__start__code 1403. In accordance with the 
present invention, the entire packet 1420 is transmitted 
without modification since there is no data field prior to the 
seq_start_code 1403. 

A decoder for decoding the output data stream may be 
provided as discussed earlier in connection with FIG. 1. For 
example, the Digital Entertainment Terminal (DEI) 168 can 
include a decoder with an associated data buffer and pro- 
cessor. The buffer receives the incoming data stream and 
provides the data to the processor for decoding and other 
processing which is required to provide a signal suitable for 
reproduction on a television. As discussed, the provision of 
null packets in the output data stream will prevent a potential 
buffer overflow at the decoder. 

Accordingly, it can be seen that the present invention 
provides a method and apparatus for splicing compressed 
packetized digital video streams. In particular, a secondary 
packetized data stream, such as a commercial, is spliced 
with a primary packetized data stream, such as a network 
television program. The system does not require the decom- 
pression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend to 
allow the insertion of commercials from local businesses 
into a nationally broadcast television program. 

Although the invention has been described in connection 
with various specific embodiments, those skilled in the art 
will appreciate that numerous adaptations and modifications 
may be made thereto without departing from the spirit and 
scope of the invention as set forth in the claims. For 
example, it is possible to locate the IPU in the decoder at the 
subscriber's home, thereby providing the subscriber with the 
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capabilities of a in-home digital data mixer such as those 
used at television, radio and recording studios. This would 
allow the subscriber to edit various audio, video and data 
sources. For example, data stored on a DVD or CD-ROM 
5 could be spliced with a main program for various educa- 
tional and entertainment purposes. 
We claim: 

1. A method for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising 
the steps of: 

providing a start signal indicating a time to initiate said 
splicing; 

determining a pre-splicing packet of said primary stream 
according to said start signal; 
15 providing an output stream where a first packet of said 
secondary stream is positioned to follow said pre- 
splicing packet; 

determining a post-slicing packet of said primary stream 
which follows said pre-splicing packet; 
20 discarding data of said pre-splicing packet which is asso- 
ciated with said post -splicing packet; and 

adding an amount of stuffing data to said pre-splicing 
packet according to the amount of data discarded. 

2. A method in accordance with claim 1, wherein the 
25 packets of said primary stream and said secondary stream 

have identifying data associated therewith, comprising the 
further steps of: 

retrieving said identifying data of said primary stream; 
and 

30 replacing said identifying data of said secondary stream 
with said identifying data of said primary stream. 

3. A method in accordance with claim 1, comprising the 
further steps of: 

providing a number L of null packets in said output stream 
35 to prevent a buffer overflow at a decoder which receives 
said output stream; and 
inserting said null packets between said pre-splicing 
packet and said first packet; 
4Q wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams 
and according to a decoding delay time of said decoder. 

4. A method in accordance with claim 2, wherein: 

the replaced identifying information of said secondary 
45 stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

5. A method in accordance with claim 1, wherein said 
pre-splicing packet is a packet of said primary stream with 

50 an anchor frame start code which is closest to said start time. 

6. A method in accordance with claim 1, wherein said 
primary stream carries compressed digital data, and said 
splicing does not require decompression of said compressed 
digital data. 

55 7. A method in accordance with claim 1, wherein: 

the discarded data of said pre-splicing packet includes at 
least an anchor frame start code and a data field 
associated therewith. 
8. An apparatus for splicing a secondary packetized data 
60 stream with a primary packetized data, comprising: 

means for providing a start signal indicating a time to 

initiate said splicing; 
means for determining a pre-splicing packet of said 
primary stream according to said start signal; 
65 means for providing an output stream where a first packet 
of said secondary stream is positioned to fallow said 
pre-splicing packet; 



02/12/2004, EAST Version: 1.4.1 



5,917,830 



23 



24 



means for determining a post-splicing packet of said 

primary stream which follows said pre-splicing packet; 
means for discarding data of said pre-splicing packet 

which is associated with said post-splicing packet; and 
means for adding an amount of stuffing data to said 5 

pre-splicing packet according to the amount of data 

discarded. 

9. An apparatus in accordance with claim 8, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, further compris- 10 
iug: 

means for retrieving said identifying data of said primary 
stream; and 

means for replacing said identifying data of said second- 
ary stream with said identifying data of said primary 
stream. 

10. An apparatus in accordance with claim 9, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 2 q 
information (PSI) and packet identifier (PID) informa- 
tion. 

11. An apparatus in accordance with claim 8, further 
comprising: 

means for providing a number L of null packets in said 25 
output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre- 
splicing packet and said first packet; 

wherein said number L is determined according to respec- 30 
tive data rates of said primary and secondary streams 
and according to a decoding delay time of said decoder. 

12. An apparatus in accordance with claim 8, wherein said 
pre-splicing packet is a packet of said primary stream with 

an anchor frame start code which is closest to said start time. 35 

13. An apparatus in accordance with claim 8, wherein: 
the discarded data of said pre-splicing packet includes at 

least an anchor frame start code and a data field 
associated therewith. 

14. An apparatus in accordance with claim 8, wherein said 40 
stuffing data is added to said pre-splicing packet in an 
adaptation field thereof, further comprising: 

means for creating said adaptation field if said adaptation 
field is not already present in said pre-splicing packet. 

15. A decoder for decoding a transport data stream which 45 
comprises a secondary packetized data stream which is 
spliced with a primary packetized data stream, wherein a 
first packet of said secondary stream is positioned to follow 

a pre-splicing packet of said primary stream, said decoder 
comprising: 50 
a buffer for storing said transport data; and 
a processor coupled to receive data from said buffer for 

processing said transport data; wherein: 
a number L of null packets are provided between said 55 
pre-splicing packet and said first packet to prevent 
overflow of said buffer; and 
said number L is determined according to respective data 
rates of said primary and secondary streams and 
according to a decoding delay time of said decoder. 60 

16. A method for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising 
the steps of: 

providing a start signal indicating a time to initiate said 
splicing; 65 

determining a pre-splicing packet of said primary stream 
according to said start signal; 



providing an output stream where a first packet of said 
secondary stream is positioned to follow said pre- 
splicing packet; 

determining a post-splicing packet of said primary stream 
which follows said pre-splicing packet; 

positioning said post-splicing packet to follow a last 
packet of said secondary stream in said output stream; 

discarding data of said post-splicing packet which is 
associated with a packet of said primary stream which 
precedes said post- splicing packet; and 

adding an amount of stuffing data to said post-splicing 
packet according to the amount of data discarded. 

17. A method in accordance with claim 16, wherein said 
post-splicing packet is a packet of said primary stream with 
a sequence start code which directly follows a sequence end 
code which is associated with said last packet of said 
secondary stream. 

18. A method in accordance with claim 16, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, comprising the 
further steps of: 

retrieving said identifying data of said primary stream; 
and 

replacing said identifying data of said secondary stream 
with said identifying data of said primary stream. 

19. A method in accordance with claim 18, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

20. A method in accordance with claim 16, comprising the 
further steps of: 

providing a number L of null packets in said output stream 
to prevent a buffer overflow at a decoder which receives 
said output stream; and 

inserting said null packets between said pre-splicing 
packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams, 
and according to a decoding delay time of said decoder. 

21. A method in accordance with claim 16, wherein: 
said pre-splicing packet is a packet of said primary stream 

with an anchor frame start code which is closest to said 
start time. 

22. An apparatus for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising: 

means for providing a start signal indicating a time to 

initiate said splicing; 
means for determining a pre-splicing packet of said 

primary stream according to said start signal; 
means for providing an output stream where a first packet 

of said secondary stream is positioned to follow said 

pre-splicing packet; 
means for determining a post-splicing packet of said 

primary stream which follows said pre-splicing packet; 
means for positioning said post-splicing packet to follow 

a last packet of said secondary stream in said output 

stream; 

means for discarding data of said post-splicing packet that 
is associated with a packet of said primary stream 
which precedes said post-splicing packet; and 

means for adding an amount of stuffing data to said 
post-splicing packet according to the amount of data 
discarded. 
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23. An apparatus in accordance with claim 22, wherein 
said post-splicing packet is a packet of said primary stream 
with a sequence start code which directly follows a sequence 
end code which is associated with said last packet of said 
secondary stream. 5 

24. An apparatus in accordance with claim 22, wherein 
the packets of said primary stream and said secondary 
stream have identifying data associated therewith, further 
comprising: 

means for retrieving said identifying data of said primary 10 
stream; and 

means for replacing said identifying data of said second- 
ary stream with said identifying data of said primary 
stream. 

25. An apparatus in accordance with claim 24, wherein: 15 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

26. An apparatus in accordance with claim 22, further 
comprising: 
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means for providing a number L of null packets in said 
output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre- 
splicing packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams, 
and according to a decoding delay time of said decoder. 

27. An apparatus in accordance with claim 22, wherein: 
said pre-splicing packet is a packet of said primary stream 

with an anchor frame start code which is closest to said 
start time. 

28. An apparatus in accordance with claim 8, wherein said 
primary stream carries compressed digital data, and said 
splicing does not require decompression of said compressed 
digital data. 

29. A method in accordance with claim 1, wherein said 
stuffing data is added to said pre-splicing packet in an 
adaptation field thereof, comprising the further step of: 

creating said adaptation field if said adaptation field is not 
already present in said pre-splicing packet. 
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